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Summary 

Multichannel sound systems are being studied as part of the Eureka 95 and Radio- 
communication Bureau TGI 0-1 investigations into High Definition Television. One emerging sound 
system has five channels; three at the front and two at the back. This raises some compatibility issues. 
The listener might have only, say, two loudspeakers or the material to be broadcast may have fewer 
than five channels. The problem is how best to produce a set of signals to be broadcast, which is 
suitable for all listeners, from those that are available. 

To investigate this area, a device has been designed and built which has six input channels 
and six output channels. Each output signal is a linear combination of the input signals. The inputs 
and outputs are in AES/EBU digital audio format using BBC-designed AESJC chips. The matrix 
operation, to produce the six outputs from the six inputs, is performed by a Motorola DSP5600I. The 
user interface and 'housekeeping' is managed by a T222 transputer. 

The operator of the matrix uses a VDU to enter sets of coefficients and a rotary switch to 
select which set to use. A set of analogue controls is also available and is used to control operations 
other than the simple compatibility matrixing. 

The matrix has been very useful for simple tasks: mixing a stereo signal into mono; creating a 
stereo signal from a mono signal; applying a fixed gain or attenuation to a signal; exchanging the A 
and B channels of an AES/EBU biistream, and so on. These are readily achieved using simple sets of 
coefficients. 

Additions to the user interface software have led to several more sophisticated applications 
which still consist of a matrix operation. Different multichannel panning laws have been evaluated 
The analogue controls adjust the panning, the audio signals are processed digitally using a matrix 
operation A digital SoundField microphone decoder has also been implemented The signal 
processing is a matrix operation, the analogue controls being used to adjust the characteristics of the 
decoded microphone. 

DSP software for specific tasks not requiring operator control has also been used Adaptive 
filtering and signal restoration are two examples. The transputer in this case can be left to perform 
the housekeeping. 

The design of the HDTV digital audio matrix is such that it can be applied to a wide variety 
of signal processing tasks. The combination of a dedicated DSP chip programmed in assembly 
language for speed of operation and a general purpose processor for user interface tasks programmed 
in a high level language has been found to be extremely useful 
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1. INTRODUCTION 

Part of the work on High Definition Television 
currently forming the Eureka 95 project and Radio- 
communicatioD Bureau Task Group lO-l investiga- 
tions involves the study of sound systems^. One 
emerging system has five sound channels intended for 
three loudspeakers at the front and two at the rear. 
Whilst this system has advantages over conventional 
mono and two-channel stereo systems it is likely that 
a considerable proportion of the audience will choose 
not to have five loudspeakers. It is necessary therefore 
to consider ways of producing outputs with numbers 
of channels fewer than five from the five input 
channels. The inverse of this problem arises when 
broadcasting material which has fewer than five 
channels. Should some form of up-conversion be used 
to create material for the extra channels? Fig. I 
(overleaf) shows some of the potential conversions 
required. 

To investigate these matters, a device was 
required with five or more inputs and five or more 
outputs. Each of the outputs would be a linear 
combination of the inputs. This would be achieved by 
a matrix operating according to the following: 

outputs = coefficients X inputs 

r n 

(?o C(}a cuv C(t2 Cos C(n Cos . ■ Co„ lo 

01 ClO Cll Cl2 Cl3 Cu C15 . . C]„ U 
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The sets of coefficients, cy, can then be defmed 
to produce the required outputs from the given inputs. 

Such a digital audio matrix has now been 
designed and built, and, as reported below, it has 
already been applied to a large number of digital 
audio studies. 

Essentially, the matrix has six inputs and six 
outputs. These are in AES/EBU digital audio format*. 
Each AES/EBU signal carries two channels, so three 
AES/EBU inputs and three AES/EBU outputs are 
provided. The output signals are derived from the 



coa 


COI 


Cm 


Cos 


C(n 


Cos . 


(■■o„ 


ClO 


Cll 


cn 


Cl3 


Cn 


Cl5 . 


Ci„ 


C20 


C2\ 


c-a 


C23 


C2A 


C25 ■ 


Cl„ 


C30 


C3l 


cn 


C33 


C34 


C35 . 


Cin 


C40 


C4l 


C42 


C43 


C+4 


C45 . 


C*n 


CnO 


C„l 


Cfl2 


Cfl3 


C„i 


Cn5 . 


Cn/t 



inputs using one of several matrices of 36 coefficients. 
The choice of coefficient matrix is made using a 
switch on the front panel. Some standard coefficient 
sets are stored in a read-only form. Other coefficient 
sets can be defined by the operator using a VDV 
plugged into the back of the device. These sets can be 
changed at will and are saved when the matrix is 
switched off. 

As described, the unit is able to perform the 
task originally intended. However, other applications 
were considered during the design phase and some 
additional controls were incorporated. For instance, a 
box providing eight rotary analogue controls can be 
plugged into the matrix. These are not intended to be 
used to vary the coefficients in the matrix directly, but 
by means of appropriate software they can be used for 
such tasks as evaluating different multichannel panning 
laws or controlling a SoundField Microphone decoding 
operation. 



2. DETAILED DESCRIPTION OF 
HARDWARE 

The matrix hardware is made up of three 
functional areas (see Fig. 2 overleaO- FirsUy, there is 
the audio input and output hardware; secondly, the 
signal processing hardware to perform the matrix 
calculations; and finally some 'housekeeping' hardware 
which controls the operation of the rest of the circuitry 
and handles the user interface. The audio input and 
output is in AES/EBU digital form via BBC AESIC 
chips^. The matrix computation is performed by a 
27 MHz Motorola DSP56001*, whUe a T222 
transputer^ performs the 'housekeeping' and user 
interface tasks. 

There are four BBC AESIC AES/EBU 
interface chips in the audio matrix. Three of these are 
used for the six input and six output channels that 
make up the matrix. The fourth AESIC is used for 
synchronisation and digital monitoring. A two-channel, 
16-bit DAC is included to provide analogue 
monitoring outputs. 

The interface between the AESIC chips used 
for audio input and output and the DSP5600I which 
performs the matrix calculations is provided by a 
programmable logic cell array. This collects the six 
incoming samples, signalling to the DSP56001 when 
each new sample has arrived, provides them on 
demand and accepts outgoing samples in return. 
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(1) 5 channel source to 5 channel destination (2) 5 channel source to 2 channel destination 
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Fig. I - Combinations of sources and destinations with different numbers of audio channels. 
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Fig. 2 - HDTV digital audio matrix board block diagram. 
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Fig. 3 - Memory map of DSP56001 on HDTV digital audio matrix board. 



The AESIC used for syncJironisation and 
monitoring is connected to the Synchronous Serial 
Interface (SSI) of the DSP56001. This is used to 
provide an AES/EBU output which can be used 
to monitor any of the input or output channels. The 
data sent is also fed to the 16-bit DAC so that 
an analogue output is available. In normal operation 
the audio samples received on the synchronisation 
input are ignored, but for non-matrix applications 
the incoming data would be available via the 
SSI. 

The DSP56001 has three banks of 8 k words 
of static RAM and a 32 k byte EPROM (see Fig. 3), 
There are three other important things in the DSP's 
memory map: 

a) the Xilinx®^ logic cell array to collect the 
audio samples, 



b) the transputer for housekeeping and user 
interface operations, and 

c) a second Xilinx® logic cell array to generate 
pseudo-random numbers for use by the 
DSP in dithering the results of the 
matrix calculations prior to truncation for 
output. 

The user interface to the audio matrix is 
managed by a transputer. The front panel controls are 
monitored by the transputer which sends the 
appropriate commands and data to the DSP56001 
when necessary. A VDU can also be connected. This 
is used to display information which may be useful to 
the operator. It can also be used to define sets of 
coefficients and control other aspects of the operation. 
The transputer memory map is shown in Fig. 4 
(overleaf). 



(S-22) 



7FFF 



0000 
FFFF 



8000 



running in 
EPROM 



T222 matrix program 
memory space 




variable space ■ 



7FFF 



0000 
FFFF 



8000 



running in 
RAM 



The transputer also monitors which AES/EBU 
inputs have signals present and at which sampling 
frequency, so that it can control the derivation of the 
circuit's clock signals. Because there are four 
AES/EBU inputs, there is a choice of which bitstream 
is to provide the master word clock for the circuitry. 
A simple priority system is used. If there is an input 
on the synchronisation input then it is selected. The 
other inputs are numbered 1, 2 and 3 and, in the 
absence of a signal on the synchronisation input the 
lowest numbered of the other inputs which has a 
signal present is selected. The sampling rate of the 
selected input is used and a phase locked loop locked 
to it to produce the clock signals for the rest of the 
circuit. The internal operation of the AESICs is such 
that, even if different inputs have different sampling 
rates, they produce real sample values although 
samples may be repeated or lost. 

An 8-channel data acquisition ADC is used in 
controlling some matrix operations. A box with eight 
rotary potentiometers can be connected to this which 
can then be used for such things as control of 
multichannel panning and SoundField Microphone 
decoding. 



3. OPERATION OF THE MATRIX 



EPROM memorv space 



FFFF 



8000 

7FFF 



0000 



7FFF 



0000 

FFFF 



8000 



7FFF-^FFFF 



0000^8000 
FFFF->7FFF 



8000^0000 







T 


T 




i 


'' / / ' ' ' ' 



original 


space split by 


by inverting 


contiguous 


T222 memory 


most significant 


space 


addressing 


address line 

the memory space 

is contiguous again 



Fig. 4 ' Memory map of T222 transputer on HDTV digital 
audio mairix board 



The matrix board can be operated with or 
without a VDU. There are two switches on the front 
panel (see Fig. 5) which are used to select the 
coefficient set and the channel to be sent to the 
monitor output. For the purposes of comparing 
multichannel up-conversion and down-conversion 
matrices, the operator need only use the rotary 
switches on the front panel. If the matrix is switched 
on with a VDU connected, then the transputer will 
use it to display information and will accept 
commands from it. This allows selection of other 
modes of operation and the display of useful 
information. 

3.1 Inputs and status indicators 

As mentioned earlier, of the four AES/EBU 
inputs only three provide audio data, the other only 
synchronisation. There is a set of three indicator lights 
for each AES/EBU input. A green LED lights when 
valid AES/EBU preambles are detected on the input. 
An amber LED lights when the input has been 
selected to provide the word clock for the matrix. A 
red LED lights if the word clock of the bitstream is 
not at the same frequency as the word clock recovered 
from the bitstream which has been selected to provide 
clocks. The VDU is used to display information about 
which input has been selected to provide clocks and to 
notify the operator of asynchronous inputs. 
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Fig. 5 ' The HDTV digital audio matrix including analogue control box. 



3.2 Coefficient set selection 

When the coefHcieot selection switch is moved 
from one position to another the transputer will gener- 
ate intermediate sets of coefficients, sending them to 
the DSP56001 in rapid succession, effectively causing 
a cross-fade from one set to the other. The number of 
intermediate sets to be generated can be defined using 
the VDU. The transputer takes about 1/20 second to 
calculate a new set of coefficients and this determbes 
the length of the cross-fade. Some of the positions will 
select coefficient sets stored in EPROM, other 
positions will select coefficient sets stored in battery 
backed-up RAM, The latter sets are defined by the 
operator using a VDU connected to the matrix. 

3.3 Monitoring 

A second front panel switch is used to select 
which input or output channel pair (corresponding to 
one AES/EBU bitstream) is sent to the digital and 
analogue monitor outputs. A volume control is 
provided for the analogue outputs. Th^e produce a 
level suitable for driving headphones. 

3.4 Dither 

At the end of each matrix calculation the 
output samples have dither added and are then 



truncated^. The level to which the output audio 
samples are dithered can be selected using the VDU. 
For simplicity, only 8, 16, 20 and 24 bits per sample 
dither levels are made available. The dither values are 
generated by hardware and a new value is used for 
each of the six output samples. 

3.5 Defining coefficient sets 

Several sets of coefficients are stored in battery 
backed-up RAM. These can be defined by the 
operator using the VDU. The matrix requests the 
switch position for which the coefficieats are to be 
defined and then the operator can enter each set of six 
numbers representing the amount of each input that 
goes to make up a particular output. 

3.6 AES/EBU channel status and user data 

The transputer has access to the channel status 
and user data'^ from the three AES/EBU bitstreams 
used in the matrix. The operator can use the VDU 
for displaying the channel status or user data 
collected frona any bitstream. The block of data is 
then displayed as individual bytes in hexadecimal 
numbers. Due to a peculiarity in the timing of the 
collection, the checksum byte is shown first rather 
than last. 
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4. TYPICAL APPLICATIONS 

The matrix, as designed, bas been used to 
evaluate different up- and down-conversion coefficient 
sets, but this is far from being its only area of 
application. A device such as the matrix is immensely 
useful for undertaking a number of tasks which are 
trivial with analogue signals but much more difficult 
with digital signals. 

Some examples are: 

• Selecting one of two AES/EBU bitstreams 
when doing an A-B comparison so that the 
same digital to analogue converter can be used. 

• Swapping left and right channels of an 
AES/EBU bitstream. 

• Simple fade-in and fade-out of up to three 
AES/EBU bitstreams. 

• Mixing left and right channels of a stereo 
signal to make a mono signal. 

• Makuig a stereo signal from a mono signal. 

• Applying fixed gain or attenuation to an 
AES/EBU signal without usmg a digital 
mixing desk. 

• Combining two signals carried on separate 
AES/EBU bitstreams into one bitstream. 

All these are easily accomplished by simple, 
user-definable, coefBcient sets. Several of these 
operations, especially small, fixed, gain changes, have 
been very useful in the testing of cascaded bit-rate 
reduction systems'. 

In addition, the matrix always generates 
AES/EBU bitstreams with valid, sensible channel 
status data regardless of the state of its inputs. This can 
be useful when interfacing equipment which does not 
properly implement channel status information to 
equipment requiring this information for its correct 
operation. 



5. MORE SPECIALISED USES 

A number of more complicated applications 
have been developed which depend on the way in 
which the set of coefficients sent to the digital signal 
processor is generated. The digital signal processor per- 
forms the same matrix operation. So far, these applica- 
tions include a digital 4-input 5-output pan-pot and a 
dual digital SoundField microphone® B-format decoder 
providing forward- and rearward-pointing microphones 



for surround-sound applications. For these applications, 
extra software was written for the transputer. The 
DSP56001 performs exactly the same task, it is only 
the generation of the coefficient set that is different. 

This type of application highlights the benefit 
of the two-processor solution. The digital signal 
processor software, written in assembly language, is 
kept fast and simple. The user interface and control 
software are made to do the more sophisticated tasks 
but the use of a high level programming language 
makes this considerably easier to do. 

5.1 SoundField microphone decoding 

The SoundField microphone is made up of 
four individual microphones, the outputs of which can 
be combined to synthesise a steerable microphone, 
with a controllable polar response. A useful format in 
which the signals can be recorded is the 'B' format, 
comprising four signals, X, Y, Z and W. These 
correspond to the output of three orthogonal figure-of- 
eight microphones and an omnidirectional microphone 
respectively. The usual analogue decoding process 
produces a crossed pair of microphones. The response 
(figure-of-eight, cardioid, hypercardioid), angle of 
separation and direction (horizontal and vertical) can 
all be controlled. 

Some experiments have been carried out into 
the use of SoundField microphone techniques applied 
to surround-sound presentations for HDTV. As some 
recordings used for this work were made digitally, it 
was considered desirable to use a digital SoundField 
microphone decoder. 

The matrix board performs the processing 
required in the digital domain. The computations are 
essentially a matrix operation. The equations to 
generate the set of coefGdents to convert the 'B' 
format signals into the outputs of the synthesised 
stereo microphones are implemented on the transputer. 
The eight analogue controls are used to adjust the 
separation angle, response and so on. 

For surround-sound work two crossed pairs 
have been synthesised, one pointing forwards and one 
pointing backwards. An example of the use of this 
arrangement would be in a sports arena. The forward 
pointing microphones provide the court or pitch 
effects, the backward pointing microphones provide 
the crowd effect. In the case of these studies, one 
particular advantage of the matrix board was its ability 
to alter the directivity of the front and backward 
pointing microphones independently. 

The VDU was used to show the operator the 
various parameters being controlled, although this is 
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not essential. The transputer software was modified so 
that a front panel switch position can be used to call 
up the SoundField microphone decoding rather than 
the usual set of coeflBcients. 

5.2 Multichannel panning 

Investigations into multichannel sound formats 
to accompany HDTV presentatioos have involved the 
assessment of different panning laws. A conventional 
stereo mixing desk, for example, would allow the 
operator to position a mono signal anywhere in the 
stereo (two channel) image. When more than two 
output channels are being considered, the choice of 
panning law, i.e. how much of the mono signal should 
be sent to each output channel to create an image in 
the required position, becomes more complicated. 
Several suggestions have been made^". The matrix 
board is well suited to the evaluation of these panning 
laws. Those laws that are described by equations are 
easily handled by the transputer. The potentiometers 
can be used to control the position of the signal in the 
stereo image. Software can be written for the 
transputer to apply the equation, or look-up table, 
describing the panning law to the readings from the 
potentiometers. Once an appropriate coefEcient-set has 
been calculated, it is sent to the DSP in the normal 
way. 

Current proposals for surround sound recom- 
mend five channels (three at the front, two at the 
rear). Using the eight rotary analogue controls it was 
possible to implement a multichannel pan pot which 
could pan each of four inputs anywhere in the image 
CTeated by the five output channels. 

5.3 Other applications, not involving a 
matrix operation 

There are several applications for which the 
HDTV digital audio matrix board has been used 
where the audio processing has not been a simple 
matrix operation. In these applications, much of the 
transputer software has remained the same (the 
selection of inputs for clock derivation, for example), 
and specific additions have been made to invoke 
dedicated DSP software. 

5.3.1 'Le Nozze di Figaro' 

The first such application was the restoration 
of a digital recording of 'Le Nozze di Figaro', made in 
1989 at Glyndebourne. During the recording there 
was a problem with the synchronisation of the 
24-irack digital audio tape recorder. The recorder was 
receiving digital signals produced by external ADCs, 
so that it needed to be synchronised to the incoming 
digital signals. However, the ADCs and the tape 



recorder were each supplied from unrelated clock 
sources. The consequences of this were not fully 
appreciated until some considerable time later. On 
play-back of the tape, the sound on odd and even 
numbered channels interchanged approximately once a 
second. These interchanges were often accompanied 
by an audible click. 

A few seconds from a pair of tracks were 
recorded onto a computer so that a more detailed 
analysis could be made. The initial analysis revealed 
that the changeover periods were slightly erratic. 
Consequently, some method for detecting (he occur- 
rence of each changeover was required. A closer 
examination revealed what was happening at the point 
of changeover: the two tracks were changing over at 
slightly different times. Using 'A' to represent samples 
intended to be recorded on the even numbered 
channel «, and 'B' to represent samples to be recorded 
on the odd numbered channel «+l, the end product 
was: 

Channel n 

AAAAAAAAAABBBBBBBBBBBBBBBBBB8 

Channel n+l 

BBBBBBBBBBBBBBBBBAAAAAAAAAAAA 

As the changeover took place, 'B' samples 
ended up in both channels. This suggested a 
mechanism for detecting the changeover points. 

Software was written for the DSP in a matrix 
board to detect when the channels were interchanging; 
this was effected by comparing the sample values in 
pairs of channels. Once the changeover was detected, 
the DSP would switch the channels back. Samples 
were lost from one of the channels during the 
changeover. In the above example, seven 'A' samples 
are lost. A combination of linear prediction and linear 
interpolation was used to make up samples to replace 
the missing ones. Prediction was used for commence- 
ment across the gap, and interpolation was used to 
make sure the signal finished at the correct level. Time 
constraints of a scheduled transmission date for the 
programme restricted the sophistication of the 
algorithms used. 

It became apparent that the technique for 
detecting the channel interchange points was not 
entirely satisfactory. The problem was that of deciding 
bow many identical sample pairs were needed to 
indicate that a changeover was taking place. There 
were places when a changeover happened over about 
30 samples and other places when it took only three 
samples. This presented a problem, because there were 
sections of the recording, usually ambience, where 
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three or four samples were the same for both channels. 
This caused the DSP to switch the channels at 
incorrect points. The problem was resolved by using 
an adaptive 'gate'. The DSP was programmed to 
know approximately when to expect a changeover and 
so only started comparing the samples shortly before 
the changeover. Since the time interval between 
changeovers was subject to both jitter (of a few tens of 
sample periods) and a gradual drift (from around 
50 000 samples to 58 000 samples between change- 
overs) the DSP updated its estimate of when to expect 
the next changeover each time it found one. 

The matrix board was then used to process 
three pairs of channels at once, in real time. Three 
pairs of tracks from one 24-track machine were played 
through the matrix board and re-recorded on to a 
second 24-track machine. Each tape was processed in 
eight passes. This was a major advantage over any of 
the 'off-line' processing options that had been con- 
sidered, since all these involved recording a single pair 
of tracks, processing them, and then replaying them to 
be re-recorded. As there were 96 track-hours of tape to 
process, and a limited amount of time before the broad- 
cast, the off-line approach was not a realistic option. 

As the tapes were bemg processed, it was 
noticed that some clicks were stiU present. These were 
found to be due to momentary exchanges of only a 
few samples just before or after the real changeover. 
Because, in this instance, the channels changed over 
simultaneously, these exchanges were not detected. A 
method for detecting them, by looking for abrupt 
changes in the mean level of the samples, was used to 
trigger further linear prediction and interpolation to 
conceal the clicks. This appeared to be satisfactory at 
the time, although some unacceptable artefacts were 
noticed later — the sections affected were processed 
using the matrix board to undo the channel 
interchanges only, leaving the clicks to be removed. 

Overall, the processing was sufficiently success- 
ful to allow the broadcast to go ahead as planned. 

5.3.2 Time delay estimation 

A second application that has proved to be 
very useful is in time-delay estimation. 

There are a number of situations when one has 
to deal with audio signals which are related in some 
way, but which have an unknown time offeet. It can 
be useful to know the time offset, either just for 
information, or to insert a compensatory delay to 
cancel it out. 

Software has been written for the DSP in the 
matrix board to perform a phase-correlation calculation 



on two audio signals. The peak in the phase- 
correlation function indicates the time offset between 
the two signals. Phase correlation is well suited to 
situations where the two signals are different mixes of 
a set of signals. Even when there are large numbers of 
unrelated components, the components which are 
common to both mixes can provide a good 
correlation. 

This technique has been used to measure the 
time difference between received FM TV sound and 
Nicam 728 TV sound, the delay through low bit-rate 
coders and decoders, and the time ofEset between 
multi-track master and stereo VT sound in television 
post-production mixing and dubbing. 

5.3.3 Adaptive noise cancellation 

The power of the matrix board also lends itself 
to other areas, such as adaptive noise cancellation. 
This study is stiU fairly new and as yet incomplete, but 
the matrix board is already proving to be an 
invaluable tool. 



6. CONCLUSIONS 

Multichannel sound to accompany high 
definition television presents problems of compatibihty 
when the source and receiver have different numbers 
of sound channels. The solution is to broadcast a set 
of 'compatible' signals such that, whatever the nature 
of the programme material transmitted, the listener can 
derive a different set of signals suited to the number of 
loudspeakers available by applying a linear matrix to 
the received signals. 

To explore the problems of such a solution, a 
digital audio matrix has been designed and built which 
takes in the original signals and produces signals 
which are linear combinations of the inputs. The 
inputs and outputs are in AES/EBU digital format 
and the processing is performed by a general purpose 
digital signal processor, a Motorola DSP56001. 
Supervisory processes, including the user interface, are 
performed by a T222 transputer. 

Several applications have been described which 
make use of the simple matrix operation. Some of 
these are operations which are simple to do in the 
analogue environment, but quite difficult with 
AES/EBU digital signals. 

With a change of signal processing software, it 
is possible to use the same hardware for even more 
applications. The HDTV digital audio matrix board 
has proved to be very useful as a system for evaluating 
digital audio signal processing ideas. 
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